Towards Natural Gesture Synthesis: Evaluating Gesture Units in a Data-Driven Approach to Gesture Synthesis
نویسندگان
چکیده
Virtual humans still lack naturalness in their nonverbal behaviour. We present a data-driven solution that moves towards a more natural synthesis of hand and arm gestures by recreating gestural behaviour in the style of a human performer. Our algorithm exploits the concept of gesture units to make the produced gestures a continuous flow of movement. We empirically validated the use of gesture units in the generation and show that it causes the virtual human to be perceived as more natural.
منابع مشابه
Multimodal analysis of speech and arm motion for prosody-driven synthesis of beat gestures
We propose a framework for joint analysis of speech prosody and arm motion towards automatic synthesis and realistic animation of beat gestures from speech prosody and rhythm. In the analysis stage, we first segment motion capture data and speech audio into gesture phrases and prosodic units via temporal clustering, and assign a class label to each resulting gesture phrase and prosodic unit. We...
متن کاملGesture and its impact of resolving lexical ambiguity
The study aimed to shed light on the use of gesture in resolving lexical ambiguity employed by TEFL students. To this end, 60 intermediate Iranian learners, studying at Kish Way Language School in Iran were recruited. The participants were randomly put into two experimental groups and one control group. Both of the experimental groups received the same teaching approach, i.e. teaching homonyms ...
متن کاملA Salience-Based Approach to Gesture-Speech Alignment
One of the first steps towards understanding natural multimodal language is aligning gesture and speech, so that the appropriate gestures ground referential pronouns in the speech. This paper presents a novel technique for gesture-speech alignment, inspired by saliencebased approaches to anaphoric pronoun resolution. We use a hybrid between data-driven and knowledge-based mtehods: the basic str...
متن کاملExploring data driven parametric synthesis
This paper describes our work on building a formant synthesis system based on both rule generated and database driven methods. Three parametric synthesis systems are discussed: our traditional rule based system, a speaker adapted system, and finally a gesture system. The gesture system is a further development of the adapted system in that it includes concatenated formant gestures from a data-d...
متن کاملLearning English Auxiliary Modal Verbs by Iranian Children
Modal verbs in English are challenging to learn by speakers of other languages. The purpose of thiswas to shed light on the use of gesture in learning English modal verbs by Persian-speaking children.To achieve this, 60 elementary Iranian learners, studying at some institutes in Karaj took part in thisstudy. The participants were randomly put into one experimental group and one control group. T...
متن کامل